LGP-30 USERS' ORGANIZATION - POOL 

Program No. F2-96 



I. PROGRAM DESCRIPTION: 



Program Title; E.R.F.P. Polynomial Fit (Statistical) Program. 

Author : C.Y. Jodatj Installation: Booz-Allen Applied Research, Bethesda, Md. 

Purpose: To fit a polynomial of the form 

Y = C + GjX + C 2 X 2 + C k X k 

where 

1 < K < 7 

and Y = y, lny, y, or In y 
as X = x, x, In x,or In x 

to a set of points (x. , y. ) using a least squares procedure . 

The print out includes an analysis of variance table j the 
coefficients, the variance and t-test values of the coefficients; 
the x. and y. , the expected y. , and a standardized deviate. 

Restrictions: 



Space available and matrix characteristics of the program have set 
these limits: 

1) 1 < k < 7 where k is the order of the 

polynomial 

2) n < 160 where n is the number of 

observations 

It is emphasized that — due to the characteristic of the particular 
matrix that is formed — as the order increases, the possibility of 
obtaining a singular matrix (a matrix where any two rows are essentially 
equal or are different everywhere by the same multiple) also increases. 
As the matrix approaches singularity there is a growing error in the 
inverse of that matrix and hence in the reliability of the over-all 
results . 

Any error can be spotted early, however, by examining the S.S. 

reg 

for succeeding orders. As the order increases, so must the S.S. 

reg 

If it does not, STOP, go on to new type or new data. 

This error is more apt to appear in the types where In is being used. 

Memory Allocation: 

The program uses all but two tracks of the drum except for fractional- 
track sector intervals. - 
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Memory Allocation - Continued. 

Central Program & Subroutines Location 

r 

Central Program, Polynomial Fit J?3Q0 - 1663 

E.R.F.P. Matrix-Vector Multiply (30.1) 1700 - 1831 

E.R.F.P. Matrix Inversion (30.0) 1900 - 2131 

(Data Storages See just below) 2200 - 3163 

Alphanumeric Output (19.0) 3U00 - 3U57 

E.R.F.P. Interpretive System 3500 - 6263 

Note: The program also uses the E.R.F.P. Logarithm and exponential subroutines 
which are included in the E.R.F.P. Interpretive System . 

The central program reserves location 0700 - 0963 for internal 
storage . 

Data in stored as follows: 

1) independent variable from 2200 - 2663 

2) dependent variable from 2700 - 3163 

3) n at 0700 



he* 



l/o r U C> 1^ f ? ' v. 

Method 



The punched tape distributed with this Statistical Program contains 
the central or "Polynomial Fit" ..program as well as the E.R.F.P. 
Matrix-Vector Multiplication No. 30.1 and E.R.F.P Matrix- 
Inversion No. 30.0. These appear on the tape in this order. 



After clearing the internal stoi. ge and having transferred to 
the desired type, the following are stored consecutively: 



n, £X,£X 2 , 2X 3 , .... £X 2k (1) 

and £Y 2 ,SY,-2XY,£X 2 Y,£X 3 Y, ...,£X h y, ...,,£2*1 (2) 

T'ieaThen, the following matrix is established from (1): 



A = 



n £X 


-£X 2 


^x 


£\ £X 2 


g,x 3 


.. ex k+1 


2 3 

£X £X^ 


a h 


.. £x k+2 



£X k £X k+1 £X k+2 ... ^X 2k 
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This matrix is then inverted giving k~ i - } denoted as follows 



,-1 



cil 
c 21 



c 12 
c 22 



c 13 
c 23 



°1 k+1 
c 2 k+1 



J c k+l 1 c k+1 2 c k+1 3 
and the inverse is multiplied by the vector G 

£X 2 Y 



c k+l k+1 



£X h Y 



where 1 < h < k 



£X k Y 



i 



to obtain the coefficient vector B 

C 



A" G - B 



S \ 



An analysis of variance table is now computed and stored. 

3 
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The following glossary defines the statistical parameters computed and 
gives the symbols that will be used henceforth. 



Parameter 



Sum of Squares 
due to regression 



Symbol 
S - S Teg 



Definition 
S ' S *reg bC 0^ y + c 1 £XY + 

C 2 £X 2 Y + ...+ C k £x k Y 

This is obtained by multiplying 
the corresponding coefficients 
of the G and B vectors, 
and summing 



Degrees of Freedom 
due to regression 

Mean Square 

due to regression 

Degrees of Freedom 
due to residual 

Sum of Squares 
due to residual 



d.f. 



reg 



2 

s reg 



d.f. 



yx 



S.S. 



y.x 



d.f. 



reg 



k + 1 



"reg 



S.S 



,/d.f.. 



d.f. 



y.x 



reg' reg 
n - d.f . reg 



S.S. = £.Y 2 - S/S. 
y.x reg 



Mean Square 
due to residual 



F - value. 



y.x 



s 2 = S.S. /d.f. v 
y.x y.x' y.x 



"reg 



/s 2 



y.x 



Sum of Squares 
Total 

Degrees of Freedom 
total 



S.S. 



total S.S. total = £Y 2 



d.f.^ . ., d.f. = n 
'total total 



With the printing of the appropriate headings, the analysis of variance table 
is printed as follows: 



Variation 
due to: 

Regression 

Residual 

Total 



Sum of 
Squares 



S.S. 



reg 



S.S. 



y.x 



S.S. 



total 



Degrees of 
Freedom 



d.f. 



reg 



d.f. 



y."< 



d.f, 



total 



Mean 
Square 

s 2 

S reg 

s2 y.x 
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Upon completion of the analysis of variance table, the coefficients 
are printed out, their variances computed and printed, and the_t-test_ 
value_(a check of the statistical significance of their difference 
from zero) is computed and printed. The following is the format: 

Coefficient Variance of t-test 

Coefficient 

C V < C 0) - c lis 2 y.x. *Co ° C 



V v(C ) 
C l v (°l) a c 22 s2 y.x \ - C x 



V v C^) 



C 2 v(C 2 ) - c 33 s 2 y.x t Q » C 2 



V v (C 2 ) 



C k v(C k) - c k+x k+i s 



2 



t 



V v(C k ) 



t in the table has n - (k + 1) degrees of freedom. 

Next, x i and y i are printed out and the expected y i (=y i ) and 

the standardized deviate are computed and printed. The j ± and the 
standardized deviate depend on the type in the following way: 

Type I: T - y - C + C-,x + C 2 x 2 + ... + C^ 
Type II: T » In y - C Q + C-,x + C 2 x 2 + c k xk 

$ ~ e °0 + c ! x + c 2 x2 + ' * • + C k xk 



A * 



Type III: Y - y = c o + c l ln x + C 2 ( ln x ) + ••• + C k^ ln x ) 



Type IV: Y - ln y - C Q + C-jln x + C 2 (ln x) 2 + ... + C k (Ln x) k 

e C + C-jln x + C 2 (ln x) 2 + ... + C k (ln x)k 



y 



LGP-30 USERS' ORGANIZATION - POOL 

Program No. F2-96 



The standardized deviate is defined as: 

A 

S.D. - T - T 



where Y - C Q + C^X + C 2 X 2 + . . .C k X k 
Input : 

The data is stored .by the. Extended Range Floating Point Interpretive system 
in the following locations: 

V 

1) the sample size n in 0700 

2) the independent variable x i beginning in 2200 

3) the dependent variable y i beginning in 2700 

: Input manually (in hex) from the flexowriter: the type, the order (k), and 
■ finally ,"tKe~sample size (n) . These are converted to q = 29 internally and 
stored . 

Note : Within the program the type and the order are converted to ERFP format, 
thus removing the need for the ERFP Float- Unfloat Subroutine (2^.1) , which 
occupies over 3 tracks of storage. 

Output : 

See "Method". 

Timing: 

No attempt has been made to optimize the program. However, to speed up the 
program, all initializing, address modification and counter manipulations 
have been carried out in fixed point. 

Operating Procedure : 

After storing the central or "Polynomial Fit" program and subroutines as 
listed in the "Memory Allocation" section, page two, a transfer to location 
0300 (i.e., ". 0000300") is made and the data (in E.R.F.P. form) is read 
and stored. * Immediately upon reading the "Exit" code o* the data tape, (a 
transfer to a stop in 1662, actual, (BP#l6) allows time for depression of the 
manual input switch) the program transfers to theot - Numeric Output and 
prints "Type". When the input light comes on, enter the type (1,2,3, or h) 
from the flex, and hit the start compute button. The type will be stored. 

When the heading "Order" is printed and the :i input light comes on again, enter 
the order (1,2,3, ..., or 7) from the flex and hit the start compute button. 
The order will be stored. 

After the heading "Sample Size" is printed and input light is on, enter the 
sample size in hex from the flex, and hit the start compute button. The 
sample size n will then be stored and the program takes off. At the completion 
of the printing of the coefficients, their variances, etc; a stop (BP #k) will 

-*See note following asterisk at the top of the next page. 
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take place to allow setting of transfer control button as explained under (two) 
below. 

* Note : These three inputs just described must be the hexadecimal equivalents 
at q = 31. They are internally converted to q = 29. 

The following are the uses made of the break points and the transf ^rn a r 
control button. 

(1) Break Point ^'l6 (Location + 1362) - Stop after reading in 
data to allow depression of manual input switch on typewriter. 

(2) Break Point ^"U (Location + 1359) - To allow the transfer 
control to be set in the following sequence: 




1600 

Terminal 
Sequence 



-» 13U6 

Compute &print] 



Kl . M 



*J (if. I-Jj, S . Us ' 



(3) Break Point's? k and^ 8 - Terminal Sequence 



/T6oo Z 

[ Brk.Pt * 8 



down 



<Br»t^ Y^f/-^ 



TjC? 



A'c-j: Type 
OhIcK\ 



A 



JfflE. 




i_£ 



Set 



K=K*\ 



- •At'/ 



)ld:Data 

type 
sample 
Jew: Order 

i Kl 



0-0-0-0-0-0-0-0-0-0-0-0-0-0-0-0-0-0-0-0-0 

Conclusion of Listing for Internal Storage 
(Con tinued from bottom of Page eight) 



Location 



Item 



0932 - 091*7 
09)48 - 0963 



product vector B 
JC x 1 ^ 1 vector G. 



LGP-30 - USERS' ORGANIZATION - POOL 



Program NO.F2-96 



Flexowriter; 

For 8 l/2 inch wide paper, tabs are set at 17, 26, 35, hh, and 53, with the 
margin at 8. 

Program Stops 



1600 


Break point 


8 prior 


to 


examining position 




of transfer 


control 


button. 


1608 


k + 1 > 8 (if transfer 


control button is up) 


1608 


Break point 1* prior 


to 


examining position 




of transfer 


control button. 


Storage : 










Location 








Item 


1832-33 








s.s. reg 


2153-51* 








d.f. 
reg 

reg 


1836-37 








1838-39 








s,s 'y.x. 


181*0-1*1 








d.f. 

y.x 


181*2-1*3 








s 2 

s y.x 


181*1*- 1*5 


V s 2 

s y.x 


181*6-1*7 








F 


181*8- 1*9 








*J 


1852-53 








Xhy 


185U-55 








£Y2 

A 


1856-57 








T 


1831* 








counter 1 


1835 








counter 2 


1858 








counter 3 


2136 








k + 1 at q = 29 


2137 








junk 


211*3 








k at q = 29 


211*1*- 1*5 








Y^ (temp, storage) 


2150 








Type at q = 29 


2151-52 








X-l (temp, storage) 


2158 








n at q = 29 


2159-60 








tempora r y storage 


2161 








2k + 1* at q = 29 


Internal Storage: 











Location 
0700-01 
0702-0729 
6732-0931 
(See Page Seven, bottom, for Storage conclusion) 

8 



Item 

sample size n 



2k 



Ix,£x2 £ X 3 £ % 

matrix A and its inverse, 



.000030080000700' 

'lU+OO* 
group' 
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80002200' ; 

• 01+00 ' ' 05+00 ' • 15+00 ' ' 26+00 ' ' 51+00 ' ' 76+00 ' j 
1' 01+00 ' 1*25+00 ' 1 '1+9+00' 1' 73+00' 1' 97+00' " 
2'll+00'2 '35+00*2 '59+00' 
group' 

80002700' 

'23+G0" 1+9+00' '76+00' '8l+00"8l+00' '81+00' 

' 73+00 " 31+00 ' ' 27+00 ' ' 1+2+00 ' ' 32+00 ' ' 28+00 ' 

'21+00" 22+00' 

exit' 



j E.R.F.P. Polynomial Fit (Statistical) 

i 

II. ILLUSTRATIVE EXAMPLES 



Type: 1 
Order : 1 
Sample Size: q 



Type 

. 10000000 



01 



Order 

. 10000000 01 



ANALYSIS OF VARIANCE TABLE 



1 



Variation 




Sum of 




Degrees of 




Mean 




due to: 




Squares 




Freedom 




Square 


F 


Regression 




.3^3352 


05 


.20000000 


01 


.171+71676 


05 M 


Residual 




.1+96161+82 


01+ 


. 12000000 


02 


.1+131+7068 


03 


Total 




.39905000 
Variance of 


05 


.11+000000 


02 






Coefficient 




Coefficient 




t-test 








.67831198 


02 


.82768287 


02 


.71+558560 


01 






.17^037^- 


00 


.39562030 


02- 


.27669633- 


01 






X 




y 




y (exp. ) 




Standardized Deviate 


.10000000 


01 


.23000000 


02 


.67657161 


02 


.2196181+2- 


01 


. 50000000 


01 


.1+9000000 


02 


. 66961OH 


02 


.8833001+0- 


00 


.15000000 


02 


. 760OOOOO 


02 


.65220637 


02 


. 53011578 


00 


.26000000 


02 


.81000000 


02 


.63306225 


02 


.87015802 


00 


. 51000000 


02 


.81000000 


02 


. 58955289 


02 


. 1081+1317 


01 


. 76000000 


02 


.81000000 


02 


.51+601+35^ 


02 


.12981051+ 


01 


. 10100000 


03 


.72999999 


02 


. 50253^18 


02 


. 111861+89 


01 


.12500000 


03 


.31000000 


02 


.1+6076519 


02 


.7I+II+UI+62- 


00 


. 11+900000 


03 


.27000000 


02 


.1+1899621 


02 


.73271+1+97- 


00 


. 17300000 


03 


. 1+2000000 


02 


.37722722 


02 


.21035126 


00 


.19700000 


03 


.32000000 


02 


.335^5821+ 


02 


.76021699- 


01- 


.21100000 


03 


.28000000 


02 


.31109300 


02 


.15291153- 


00 


.23500000 


03 


. 21000000 


02 


.269321+01 


02 


.2917^818- 


00 


.25900000 


03 


.22000000 


02 


.22755503 


02 


.3715H692- 


01- 



.1+225611+2 02 



All typing on this page (with exception of a few lines at top) was done by the 
computer-controlled Flexowriter. " 
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E.R.F.P. Polynomial Fit (Statistical ) 
II. ILLUSTRATIVE EXAMPLES 



Type 
.lOOOOOOO 01 



Order 
.20000000 01 



ANALYSIS OF VARIANCE TABLE 



Variation 




Sum of 




Degrees of 




Mean 




due to: 




Squares 




Freedom 




Square 


F 


Regression 




.35599075 


05 


.30000000 


01 


.II866358 


05 -3< 


Residual 




. U3059252 


04 


. 11000000 


02 


.39144774 


03 


Total 




.39905000 
Variance of 


05 


. 14000000 


02 






Coefficient 




Coefficient 




t-test 








.59207018 


02 


.12275980 


03 


.53437374 


01 






.1117^761 


00 


.52501387 


01- 


.48770010 


00 






.II723U99- 


02- 


.82046933 


06- 


.129I+2736- 


01 






X 




y 




y ( exp. ) 




Standardized Deviate 


. 10000000 


01 


.23000000 


02 


. 59317593 


02 


.18356089- 


01 


. 50000000 


01 


.49000000 


02 


.59736447 


02 


. 54265485- 


00 


.15000000 


02 


.76000000 


02 


.60619^53 


02 


.77738271 


00 


.26000000 


02 


.81000000 


02 


.61319947 


02 


.99469370 


00 


. 51000000 


02 


.81000000 


02 


.61856864 


02 


.96755620 


00 


. 76000000 


02 


.81000000 


02 


.60928343 


02 


.10144867 


01 


.10100000 


03 


.72999999 


02 


.58534385 


02 


.73113910 


00 


. 12500000 


03 


.31000000 


02 


54857501 


02 


.12058355- 


01 


. 14900000 


03 


.27000000 


02 


.49830071 


02 


.11539058- 


01 


.17300000 


03 


. 42000000 


02 


.43452093 


02 


.73393507- 


01- 


. 19700000 


03 


.32000000 


02 


.35723569 


02 


.18820125- 


00 


.21100000 


03 


.28000000 


02 


.30591573 


02 


.13098649- 


00 


.23500000 


03 


.21000000 


02 


.20724682 


02 


.13915472 


01- 


.25900000 


03 


.22000000 


02 


.95072440 


01 


.63142439 


00 



.30314029 02 



All typing on this page (with exception of a few lines at top) was done by 
the coinputer-eonhi-oner) FDewwriter. 
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E.R.F.P. Polynomial Fit (Statistical) 
II. ILLUSTRATIVE EXAMPLES 



Type: h 
Order : 1 
Sample Size: q 



Type 
.1*0000000 01 



Order 
.10000000 01 



ANALYSIS OF VARIANCE TABLE 



Variation 




Sum of 




Degrees of 




Mean 




due to: 




Squares 




Freedom 




Square 


F 


Regression 




.195026U6 


03 


.20000000 


01 


.97513231 


02 .321+00777 


Residual 




.36II51U6 


01 


.12000000 


02 


.30095955 


00 


Total 




.19863798 
Variance of 


03 


.11+000000 


02 






Coefficient 




Coefficient 




t-test 








.39963738 


01 


. 16289 56U 


00 


.99017367 


01 






.65096617- 


01- 


.85030838 


02- 


.7059^389- 


00 






X 




y 




y (exp. ) 




Standardized Deviate 


.10000000 


01 


.23000000 


02 


. 5I+I+OO525 


02 


.15692366- 


01 


. 50000000 


01 


. 1+9000000 


02 


.U8989I+I+I+ 


02 


.3921+91+79 


03- 


.15000000 


02 


. 76000000 


02 


.1+5608263 


02 


.93081715 


00 


.26000000 


02 


.81000000 


02 


. y+ooi+098 


02 


.11122289 


01 


. 51000000 


02 


.81000000 


02 


. '+2115897 


02 


.11921736 


01 


.76000000 


02 


.81000000 


02 


.1+1036328 


02 


.12395080 


01 


.10100000 


03 


.72999999 


02 


.1+0283626 


02 


.10836977 


01 


.12500000 


03 


.31000000 


02 


.397281+25 


02 


.1+5220729- 


00 


.11+900000 


03 


.27000000 


02 


.39276793 


02 


.68319095- 


00 


.17300000 


03 


.U2000000 


02 


.38896800 


02 


.13991597 


00 


.19700000 


03 


.32000000 


02 


.3856921+2 


02 


.3^0357^7- 


00 


.21100000 


03 


. 28000000 


02 


.38397255 


02 


.57561593- 


00 


.23500000 


03 


.21000000 


02 


.38128928 


02 


. 10872280- 


01 


.25900000 


03 


.22000000 


02 


.37888328 


02 


.990891U0- 


00 



03 



All typing on this page (with except.-ion of a few lines at top) was done by 
the computer- control T^H PDey^writer, 
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E.R.F.P. Polynomial Fit (Statistical ) 
II. ILLUSTRATIVE EXAMPLES 



Type 

. 40000000 01 



Order 
.20000000 01 



ANALYSIS OF VARIANCE TABLE 



Variation 
due to: 

Regression 
Residual 

Total 



Sum of 
Squares 

.197925^9 
.712U8817 
.19863798 



03 
00 

03 



Degrees of 
Freedom 

.30000000 01 

. 11000000 02 
.14000000 02 



Mean 
Square 

.65975163 
.6^771653 



02 
01- 



.10185808 04 



Coefficient 

.29914932 01 
.10220511 01 
.17896003- 00 



Variance of 
Coefficient 

. 57616821 01- 
.28233858 01- 

.715^8605 03- 



t-test 

.12U62736 02 

.60825753 01 

.6690^518- 01 



x 

.10000000 

. 50000000 
.15000000 
.26000000 
. 51000000 
.76000000 

. 10100000 

. 12500000 
.11+900000 
.17300000 
. 19700000 

.21100000 

.23500000 
.25900000 



y y (exp. ) 

01 .23000000 02 .19915398 02 

01 .1+9000000 02 .61+900964 02 

02 .76OOOOOO 02 .85357565 02 
02 .81000000 02 .832i+0924 02 
02 .81000000 02 .696U61+45 02 

02 .81000000 02 .580U8785 02 

03 .72999999 02 .1+92373^0 02 
03 .31000000 02 .1+2702213 02 
03 .27000000 02 .37514081 02 
03 .42000000 02 .33310880 02 
03 .32000000 02 .29845139 02 
03 .28000000 02 .28093093 02 
03 .21000000 02 .25462172 02 
03 .22000000 02 .23216594 02 



Standardized Deviate 

. 56581268 00 

.11042801- 01 

.45624631- 00 

.10722883- 00 

.59338235 00 

.13090833 01 

.15473584 01 

.12583901- 01 

. 12922436- 01 

.91073869 00 

.27392160 00 

.1301+2737- 01- 

.75705077- 00 

.21149080- 00 



All typing on this page (with exception of a few lines at top) was done by 
the computer-controlled Flexowriter. 
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Ts 



_2 



1* i 1 -* ;3 jg jQ |Q 



Li2_i__jL]L]Li_j_. 



i-lLx_l_LJ__E_4^j__L_! 



ill' 



_J_J_JL]L_L_L__ 
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io II 

7 
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/ Tab.UC.F.iLS \ Variance 



^sjsXo 
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